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[57] ABSTRACT 

An audio effects processing system and method performs 
audio effects processing on a subband-by-subband basis 
using less memory and computational resources than audio 
effects produced through post processing of a fullband audio 
signal. The input fullband audio signal is split into subbands 
and the compressed subbands may be stored in memory of 
the system as compressed audio subband data or may be 
generated by real time processing of a fullband audio signal. 
The system stores in memory a set of prototype subband 
effects filters, the set including echo, flange, chorus, and 
reverberation effects filters. A subband filter customization 
procedure allows a sound system designer to build custom- 
ized versions of the prototype subband effects filters. One or 
more of the customized subband effects filters are applied to 
one or more of the subbands comprising the compressed 
audio subband data. The compressed audio subband data is 
then processed through a synthesis filter bank which decom- 
presses and decodes the compressed audio subband data to 
produce a decompressed decoded audio output signal with 
the audio effects incorporated in it. The system uses less 
memory and computational resources by applying the cus- 
tomized subband effects filters to less than a full set of 
subbands comprising the compressed audio subband data 
without suffering any psycho acoustical loss. Each subband 
is processed separately and independent of the other sub- 
bands. By computing effects separately for each subband, 
different effects can be performed on different frequency 
regions. This allows different effects to be placed on the 
subbands, providing the ability to create a multiband audio 
effects processor. 

12 Claims, 7 Drawing Sheets 
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SYSTEM AND METHOD FOR EFFECTS 
PROCESSING ON AUDIO SUBBAND DATA 

The present invention relates generally to performing 
audio effects processing on audio subband data for produc- 5 
ing audio effects equivalent to those produced by post- 
processing a decompressed decoded fullband audio signal, 
where the subband effects processing is accomplished using 
less memory and computational resources than fullband 
processing techniques. 

BACKGROUND OF THE INVENTION 
With the general acceptance of audio compression 
standards, such as the MPEG I Audio standard, there has 
been a rapid growth in the use of compressed audio in 
applications running on personal computers, workstations 15 
and other platforms. Examples of applications using com- 
pressed audio include recording studios, real-time network 
audio transmission, direct digital satellite broadcasting, and 
video conferencing facilities. 

For most of the above-mentioned applications, some sort 20 
of audio processing, such as adding audio effects or increas- 
ing the sound quality, is desired by the sound system 
designer. Simple examples of this audio processing involve 
the addition of artificial reverberation for a movie, or an 
added chorus effect to make vocal recordings sound fuller. ^ 
Currently, this desired audio processing is achieved by 
post-processing a decompressed decoded fullband audio 
signal. Audio post-processing methods taught by the prior 
art usually require special hardware for computation and 
large amounts of memory. It would be highly desirable to 
provide a sound system designer with a system and method 30 
that can perform similar audio processing using less memory 
and computational resources. 

The prior art teaches audio and video manipulation 
techniques, such as dissolve and rotation (see, B. C. Smith 
and L. A. Rowe, "Algorithms for Manipulating Compressed 35 
Images", Computer Graphics and Applications, Vol. 13, No. 
5, pp 34-42, September 1993, and B. C. Smith, "Fast 
Software Processing of Motion JPEG Video," Proc. ACM 
Multimedia 94, San Francisco, Calif., October 1994), for 
working with compressed images and video. M. A. Broad- 40 
head and C. B. Owen, "Direct Manipulation of MPEG 
Compressed Digital Audio/' Internal report from Bregman 
Electronic Music Studio, Dartmouth College (1995) teaches 
simple mixing of audio streams and equalization on com- 
pressed audio. However, there is no prior art system or 45 
method that can perform effects processing on compressed 
audio data. Thus, there is a need for a system and method for 
performing audio effects processing on compressed audio 
data using less memory and computational resources than 
currently available fullband audio post-processing tech- 50 
aiques. 

Furthermore, current audio post-processing methods are 
limited to generating audio effects on the entire frequency 
range of a particular audio signal. Although certain prior art 
techniques have the ability to perform subband-by-subband 55 
processing, such techniques have required the use of over- 
sampled transforms, which increases the memory and com- 
putational resources used. Thus, there is a need for a system 
and method that provides the ability to perform audio effects 
processing on a subband-by-subband basis with little or no 60 
psycho acoustical loss, while using significantly less memory 
and computational resources than processing the corre- 
sponding fullband signal. 

SUMMARY OF THE INVENTION 

CO 

In summary, the present invention is a system and method 
for performing audio effects processing on audio subband 



164 

2 

data. Subband-by-subband effect processing produces audio 
effects equivalent to those produced by post-processing a 
decompressed decoded fullband audio signal. The subband 
effects processing is accomplished using less memory and 
computational resources than fullband processing tech- 
niques. 

The present invention provides a sound system designer 
with a set of prototype subband effects filters that can be 
customized by the sound system designer. The set of pro- 
totype subband effects filters includes filters to produce echo 
effects, flange effects, chorus effects, and reverberation 
effects. By executing a subband filter customization 
procedure, the sound system designer can create customized 
versions of a selected prototype subband effects filter by 
adjusting the values of the parameters associated with the 
selected prototype audio effects filter. This allows the sound 
system designer to generate customized subband effects 
filters that produce audio effects to suit the sound system 
designer's needs. 

Audio effects processing is performed by applying one or 
more of the customized subband audio effects filters to one 
or more of the audio subbands of compressed audio subband 
data. The compressed audio subband data is stored in 
memory, or can be generated in real time from a fullband 
fullrate audio input signal using an analysis filter bank. The 
customized subband effects filters are then applied to one or 
more subbands of the compressed audio subband data. The 
compressed audio subband data is then processed by a 
synthesis filter bank that decodes and decompresses the 
compressed audio data. The effects processing is performed 
as part of the decompression and decoding step performed 
by the synthesis filter bank. There is no need to perform any 
further post processing using external effects processors. 
The audio sound effects produced using subband-by- 
subband processing are psycho acoustically equivalent to 
corresponding effects produced by processing a fullband 
audio signal. 

By performing audio effects processing on compressed 
audio subband data, the present invention uses less memory 
and computational resources than those required by decom- 
pressed fullband audio signal post processing techniques to 
produce equivalent audio effects. By applying the custom- 
ized subband effects filters on less than a full set of 
subbands, the present invention saves memory and uses 
fewer computational resources, and produces effects equiva- 
lent to those produced by post processing a decompressed 
decoded fullband audio signal. 

The present invention also allows for multiband effects 
processing. Each of the subbands of the audio subband data 
can be processed separately and independent of the other 
subbands. This allows different customized subband audio 
effects filters to be placed on the separate subbands. Since 
effects are computed separately for each subband, different 
effects can be performed on different frequency regions to 
achieve multiband effects processing. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Additional objects and features of the invention will be 
more readily apparent from the following detailed descrip- 
tion and appended claims when taken in conjunction with 
the drawings, in which: 

FIG. 1 is a block diagram of a computer system incor- 
porating the audio effects processing system. 

FIG. 2 is a block diagram depicting an exemplary setup of 
the various components comprising the present invention. 

FIG. 3 shows the prototype model of a filter for producing 
an echo audio effect 
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FIG. 4 shows the prototype model of a filter for producing to create customized versions of a selected prototype sub- 

a flange audio effect. band effects filter. The selected prototype subband effects 

FIG. 5 shows the prototype model of a filter for producing filter . can 1> C aDV onc of the subband audio effects filters 

a chorus audio effect. contained in the set of prototype subband effects filters 118. 

t-f/-o ck £t> a cr^ u *u * ♦ j i c 5 The subband filter customization procedure allows the sound 

nGS.6A ? 6B and 6C show the prototype model of a filter sys tem designer independent conLl of the parameters asso- 

for producing a reverberation audio effect. ^ wi(h * he prototype subband ; ffects fiItcr as a 

FIG. 7 is an illustration depicting an exemplary setup for function of frequency range. Using the selected prototype 
producing multiple audio effects by application of different subband effects filter as a base template, the sound system 
audio effects to the subbands of compressed audio subband 1Q designer by executing the subband filter customization pro- 
data, cedure 132, can adjust parameters associated with the 

FIG. 8 is a block diagram of an alternate embodiment of selected prototype subband effects filter to produce the effect 

the present invention. desired b y the sound s y stem designer. 

As shown in FIGS. 3, 4, 5, and 6A-6C, the parameters 

DESCRIPTION OF THE PREFERRED tnat can be customized for each of the selected prototype 

EMBODIMENTS 15 subband effects filter include a delay line length 301, 401, 

501-1,2,3, 601-1,2, one or more feedback scalars 302, 402, 

Referring to FIG. 1, there is shown an audio effects and one or more feedforward scalars 403, 502, 602. For 

processing system 100 for performing audio effects process- example, if the sound system designer wants to create a 

ing on compressed audio subband data. The audio effects customized subband flange effect, the designer executes the 

processing system 100 can be a personal computer, a work- 20 filter customization procedure and selects the prototype 

station or any other similar computer platform. subband flange effects filter shown in FIG. 4. The sound 

In the preferred embodiment, the audio effects processing s y stem designer can then adjust the feedforward gain scalar 

system 100 includes a central processing unit (CPU) 104, a 403 ' the feedback g ain **lar 402 > ™& tbe dela y length 401 

user interface 106, an audio output device 108, and memory ^ WG ^ S t0 P[ oduc ? 5 cu f tomized flan | L e subb * nd audio 

110. Memory 110 stores an operating system 112, com- 25 f ffect ™ er * S ^ d& u g ™' V? reSUUaDt 

a a- ll j j * 11/ TV * t_ \ tomized subband enects filter can be saved m memory of the 

pressed audio subband data 116, a synthesis filter bank 114 & t • inn ^ 

p , j j j- It. -. audio enects processing system 100. One or more custom- 

for decompressing and decoding the compressed audio ^d subband effects filters can be grouped together to form 

subband data 116 decompressed decoded audio output a ^ defined of customized J bband % ffects filters 

signal files 136, a set of prototype subband effects filters 118 134 for processing the whole rarjge of impressed audio 

consisting of audio effects that can be applied to the com- JU subband data. 

pressed audio subband data 116, stored procedures 130 ^ synt hesis filter bank 114 processes the compressed 

including a subband filter customization procedure 132, audio subband data 116, which has been processed by 

customized subband effects filters 128, and groups of cus- subband audio effects filters, to produce a decompressed 

tomized subband effects filters 134. decoded audio output signal. Thus, there is no need to 

In the preferred embodiment, the compressed audio sub- perform any post-processing of the decoded decompressed 

band data 116 is stored in memory 110 of the audio effects audio output signal. Consequently, external audio processors 

processing system 100. Alternately, memory 110 may also requiring special hardware are no longer needed, 

store an analysis filter bank 138 that processes in real time Furthermore, audio effects produced using subband-by- 

a fullband fullrate audio signal received from a real time subband processing are psychoacoustically equivalent to 

audio source or from disk files 140. The analysis filter bank 40 ^ osc V^ductd by post-processing a decompressed audio 

is responsible for compressing, encoding and splitting the signal. 

fullband fullrate audio input signal into subbands of criti- Referring to FIG. 2, there is shown a block diagram 

rally sampled compressed audio data 116. Each subband de Pi cun S an exemplary setup for performing subband-by- 

carries critically sampled data for a distinct frequency range, AQ * udl £ ° ^ t ts Processing usmg an MPEG Audio I 

with the 32 subbands covering the frequency range 0 to 45 K i^^f } H ^ ^ ^if 

oon r,T,, /• . uu a a\ c c filter bank 138 aad ^aiJtoe^sfilter bankjl^. The MPEG 

22.05 kHz. (i e each subband carries data for a frequency ^ k ^ bank t^o^isK^od^and splits the 

range of about 689 Hz.). If other samphng frequencies F are ^ audio ^ al 10? mtQ 

used, the frequency range of each subband will be F 5 /32. fguaU y snacedlubblnd^ compreSedtX 

The term "critically sampled subband data" means that 50 data. As mentioned earlier, in the preferred embodiment, the 
the total amount of subband data (i.e., the number of data compressed audio subband data 116, comprising the thirty- 
samples in the subband data) is equal to the amount of data two equally spaced subbands, is either stored in memory 110 
(i.e., number of data samples) prior to its division into or generated in real time by the aaal^sjs^l|ex±a^ 
subband data. Hie use of critically sampled subband data is 0ne or more of the customized subband effects fiUers 12g 
important because it minimizes the number of data samples 55 generated by the ^und system designer can then be applied 
that need to be processed by the subband effects filters t0 one or more su5bands n6 ^ 2 . The process of creating 
without loosing any of the information content of the signal the mUsmind subband audio effects filters was explained 
being processed. earlier. After applying the customized subband effects filters 

The set of prototype subband effects filters 118 stored in U8, the compressed audio subband data 116 is then pro- 
memory 100 comprises of effects filters that can be applied 60 cessed through the synthesis filter bank 114 which.synthe- 
to the compressed audio subband data. This set includes sizes a decompressed decoded audio output signal&3d)from 
filters to produce echo effects 120, flange effects 122, chorus the compressed audio subband data 116. The decompressed 
effects 124, and reverberation effects 126. The filter models decoded audio signal with the audio effects incorporated in 
corresponding to the echo, flange, chorus, and reverberation it can then be heard using an audio output device. The audio 
effects are shown in FIGS. 3, 4, 5, and 6A-6C respectively. 6S outpu t effects produced are equivalent to effects produced 

The subband filter customization procedure 132, when through post-processing a decompressed decoded output 

executed by the CPU 104, allows a sound system designer signal. v 
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As shown in FIG. 2, the MPEG analysis filter bank 
outputs data called "side information/' The side information 
generated by the analysis filter bank indicates the relative 
amount of psychoacoustically important information in each 
of the 32 subbands. When the analysis filter bank is con- 5 
figured to perform data compression, the side information 
represents the "bit allocation" for each subband, which 
indicates the number of bits used to represent the data 
samples in each subband. Subbands with relatively little 
information content have data that is quantized with rela- 10 
tively few bits (e.g., 4 bits per data sample), while subbands 
with larger amounts of information content have data that is 
quantized with a relatively large bits (e.g., 12 to 16 bits per 
data sample). 

In an alternate embodiment of the present invention, 15 
discussed below with reference to FIG. 8, this side infor- 
mation is used to dynamically allocate memory and com- 
putational resources to various channels for performing 
effects processing on various subband channels. 

20 

Memory and Computational Resource Savings by 
Performing Effects Processing on A Subband Level 

The present invention, by performing audio effects pro- 
cessing on a subband level, uses less memory and compu- 
tational resources than required by post processing tech- 
niques applied to fullband fullrate audio signals to produce 
equivalent effects. The MPEG filter bank embodiment will 
be used to illustrate how these memory and computational 
savings are achieved. 

As mentioned earlier, the MPEG filter bank splits the 
fullband fullrate input audio signal into thirty-two equally 
spaced critically sampled subbands. The mapping of 
uniform-frequency effects filters into the individual sub- 
bands is accomplished by reducing the length of any delay 
element in the original fullband filter by the number of 
subbands (32 for MPEG filter banks using MPEG layers I 
and II), and multiplying_an y^ modulation frequency by the 
number of subbands . ^^orm-frequenc^ffects filters, such 
as echo , flange^^anH^chonK^ lters alteTthe si gnal the^ame 
way for all frequencies. Thus, a single comb filter, sucrTas 
an echo filter, has a uniform spacing of poles across all 
frequencies. 

For example, if an echo effect having a delay line length 
of 300 msec is desired, a subband filter with the design 
shown in FIG. 3 is used with the same feedback scalars but 
a 300 msec/32-9.4 msec delay line length. This customized 
echo effect filter can then be placed on each subband, and 
then the subbands run through the synthesis filter bank, to 
produce an audio output signal which emulates the echo 
effect. 

The number of calculations and memory words required 
for effects processing of 32 critically sampled subbands is 
equal to that of a fullband fullrate audio signal. This is due 
to the fact that all the delay line lengths have been reduced 55 
by a factor of 32. The subband signals each flow (i.e., have 
data samples) at l M of the sampling frequency of the input, 
which is 44.1 kHz (MPEG allows audio signals to be 
recorded at 48 kHz, 44.1 kHz, 32 kHz, 22.05 kHz and 16 
kHz). 60 

Memory and computational savings are achieved by 
applying the customized subband effects filters to less than 
a full set of subbands to achieve results equivalent to those 
produced by post processing of decompressed audio signals. 
Since effects filters are applied to less than a full set of 65 
subbands, the memory and computational resources used are 
significantly less than in conventional techniques. 
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Memory and computational savings achieved by selective 
application of the effects filters to a subset of the subbands 
can be illustrated using the flange audio effects filter 
depicted in FIG. 4. Sound tests have shown that to produce 
a flange audio effect, it does not make much difference if 
subbands 16 through 32 are not flanged at all, but passed 
through unprocessed. Thus, identical flange effects filters 
can be placed on subbands 1 through 15, leaving subbands 
16 through 32 unprocessed. This results in more than a 50% 
reduction in computation and memory usage as shown by 
the following calculation. 

For an average delay line length of 3 msec, the number of 
samples (i.e., memory locations for storing audio samples) 
needed for filtering a fullband signal of sampling frequency 
44.1 kHz (which is the sampling frequency at which a filter 
such as MPEG allows audio signals to be recorded) is 
calculated as follows: 

# of samples needed of fullband - 3 msec * 44.1 kHz 
= 132.3 samples 
- 132 samples 

# of samples needed of each subband = (44.1 .kHz/32) x 3 msec 
= 4.134 samples per subband 
« 5 samples 

For the flange effect, only subbands 1 through 15 are 
processed while subbands 16 through 32 are left unproc- 
essed. Therefore, 



# of samples needed for processing 
subbands 1 through 15 



= 5 samples per subband * 15 
= 75 samples < 132 samples 



Thus, to produce equivalent flange effects, only 75 samples 
are needed if processing is done on a subband-by-subband 
basis compared with 132 samples for fullband processing. 
Consequently, the computational resources and memory 
needed for filtering 15 of 32 subbands is substantially less 
than the memory and computational resources needed for 
fullband filtering. 

The same procedure can be applied to the echo and chorus 
effects, except that only the first 10 subbands need to be 
processed through the respective audio effects filters. This 
results in even greater memory and computational resource 
savings. 

Memory and computational resource savings can also be 
achieved for the reverberation audio effect. Commercial 
reverberators are typically band limited to 8 kHz (see, P. 
White, "Creative Recording: Effects and Processors," Music 
Maker Books, 1989). This cutoffjs applied because mate- 
rials from most room interiors only reflect low frequencies. 
Therefore, if reverberator audio effects filters are only placed 
in subbands for the 0 to 8 kHz frequency range, only about 
36% of the memory and computational resources that would 
be required for fullband filtering are utilized to produce 
equivalent effects. 

Applying Different Audio Effects on A Subband 
Level to Achieve Combinations of Audio Effects 
As shown in FIG. 2, each one of the thirty-two equally 
spaced subbands can be processed separately and indepen- 
dent of the other subbands. Since effects are computed 
separately for each subband, different customized subband 
effects filters can be placed on different frequency regions. 
As a result, a customized, multiple audio effects processor is 
easily implemented using the present invention. 
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For example, consider a case where the music track of a encoder can also be performed in workstation based imple- 

bass player needs to be processed. The lowest frequencies of mentations of the invention such as the system 100 shown in 

the input bass audio signal, say below 600 Hz, should be left FIG. 1. 

unaltered so as to preserve the fundamental and first few while the preferred embodiment of the present invention 

harmonics. This would translate to not applying a custom- 5 uses an MPEG filter bank because it is an efficient transform, 

ized subband effects filter to the lowest subband and leaving and is a standard that is already available on many platforms 

it unprocessed. But, the other subbands can now be pro- & over the world, other filter banks that produce critically 

cessed without disturbing the timbre of the lowest frequen- sampled subbands, each covering a different frequency 

cies. As shown in FIG. 7, a customized flange effect filter range) C an also be used with the present invention. 

701 could be placed on subbands 2 through 9 for frequencies 10 - to „^ t u 0 ™™*- *• u a- 

c • f i cc\f\ * £Annu * j l cc . r or instance, the present invention can be used in a system 

of approximately 600 to 6000 Hz, a customized chorus effect • . an k i • j j *u 

cu hm ij u i j t!uj^*^^rr m which the MPEG filter bank is cascaded with FFT 

filter 702 could be placed on subbands 4 to 14 for frequen- . , iU , r , . . , , 

f . 4 K onnft , 1AnnntI j , . . vocoders on each subband, that further divides the audio 

cies ot approximately 2000 to 10000 Hz, and a customized l. j . , . . u 1 r L j <* 

u * fc cu 7Ai iju 1 j r, i X subband signals into smaller, complex frequency bands of 

reverberator effect filter 703 could be placed on subbands 2 . c c i r™ , J r 

. , „ r . . tl , miT _ varying finer frequency resolution. The lowest frequency 

to 32 for all frequencies oyer approximately 600 Hz. This 15 sub ' bands ^ ^ v > ocoders f fr ^ / 

multiband approach leaves the sound system designer many n ~ tt l-i *i_ l * r i_. i 

, e c j i i • rr i small as 2 Hz, while the highest freqency subbands could 



. i y & have vocoders with poorer frequency resolution such as 50 

previously avauaoie. Hz> iUowing beUer 

time resolution. 



more degrees of freedom when layering effects than were 
iblc. 

Alternate Embodiments 20 Vocoder-style effects require higher frequency resolution 

_ 0 L - ■ , . „ than MPEG filter banks require (MPEG uses 44.1 kHz/32- 

FIG. 8 shows an audio signal processing system 800 that 687 Hz wide sub bands). In order to increase this frequency 

is similar to the system 100 shown in FIG. 1 except that the resolution, it is required to perform a Fast Fourier Transform 

analysis filter bank, effects filters and synthesis filter bank (FFX ) on each MPEG subband. It is also necessary to 

are implemented in an "MPEG and filter effects" integrated generate magnitude and phase at each bin for a vocoder. The 
circuit 802 that is controlled by a host computer 804. As just 25 means that eac h bin output must be complex, and this 

mentioned, circuit 802 includes an MPEG analysis filter requires the use of a complex transform like the FFT. The 

bank 806, and an MPEG synthesis filter bank 808. The 01ltput of ^ MPEG filter bank subbands are real-valued 

circuit 802 also includes a programmable effects filter bank (not comp i ex ) signa is, an d one cannot extract magnitude and 

810 that is programmable in by the host computer 804 in phase from these signals without an additional complex FFT. 

much the same way that a field programmable logic array ^ , . & A . „ 

(FPLA) can be programmed by downloading a binary file of CerUl ? cffect *' es P ecial ]y "™ stretching . and 

connection control data into the circuit 802 compressing, can be performed on the resulting subband 

_ t vocoder data without distortion of the pitch (i.e., frequency 

u ?ti? St J C0I T ,er 804 ' eceiV ! s from ' he ^ sis filter characteristics) of the resulting signal. Furthermore, 

bank 806 side information that indicates the relative amount memory ^ com p Utation res0 urces can be allocated to these 

of psychoacousticaUy important information in each of the Darrow subbands based 0Q tbe relative amoum of ho . 

32 subbands generated by the analysis filter bank 806. From accoustica Uy important information in the various bands, 

the side information the host computer can dynamically ., . . ... _ . 

allocate effects filters using the resources available in the he P resent '"yention has been described with 

programmable effects filter bank 810. In particular, in addi- * fe " n ? to ! f ,f w s P ecific embodiments, the description is 
tion to using the side information to determine which 40 f 1 ^™ 1 ™ ° f mve ^ 0D ™ d * ■ "»t l ° be construed as 

channels to filter with various effects, the delay line length ^ing the ^invention. Various modifications may occur to 

for filters such as the reverb, chorus and flange effects filters dtffled ? ? 6 M WlthoUt departtng from the true spirit 

can be varied in accordance with the amount of psychoac- *? d **° p6 ° f the mV6nt,0n aS defined ^ appended 

coustically important information in each of the 32 45 C * i • 

subbands, such that bands with more psycho accoustically if 18 ° 1 * ime ~ m ' . „ 

important information are assigned filters with longer delay I ^ a ? dl ° effeCtS P rocessin g system for performing 

fines than bands with less psychoaccoustically important aU( ^ 0 effectS P^^g 011 compressed audio subband data, 

information. This allocation of effects filters, and delay line SyStCm com P rism g : 

lengths within those effects filters is performed by a subband an audio °. llt P ut dcvicc for hearing results of audio effects 

filter customization procedure 812 that takes into account processing; 

the side information as well as the limited resources avail- a data processor coupled to said audio output device; 
able in the programmable effects filter bank 810. a memory coupled to said data processor, said memory 
Since the amount of computational resources required to storing compressed audio subband data, a set of pro- 
preform effects filtering is proportional to delay line lengths, ss to type subband effects filters, customized subband 
both memory and computational resources can be dynami- effects filters, and stored procedures that are executed 
cally allocated as a function of the side information provided by said data processor; 

by the MPEG encoder (i.e., analysis filter bank). said compressed audio subband data comprising subbands 

The host computer can receive for storage (e.g., on disk each covering a different frequency range; 
or tape storage media) compressed audio subband data from 60 said set of prototype subband effects filters including 

the analysis filter bank 806, or from the programmable effects filters corresponding to different audio effects 

effects filter bank after the subband data has been filtered by that can be applied on a subband-by subband basis; 

the effects filters. The host computer can also transmit said stored procedures including a subband filter customi- 

subband data from memory 110 to the programmable effects za tion procedure for creating said customized subband 

filter bank 810 for effects processing. 6S effccls mtcis 5y customiz i ng one or more prototype 

The dynamic allocation of memory and computation subband effects filters from said set of prototype sub- 

resources based on side information from the MPEG band effects filters; and 
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a synthesis filter bank coupled to said data processor for 
decoding said audio subband data, and performing 
audio effects processing on said compressed audio 
subband data as part of said audio subband data 
decoding, said audio effects processing performed by 5 
applying one or more of said customized subband 
effects filters to a subset of said subbands of said 
compressed audio subband data, wherein said subset is 
less than the full set of said subbands, said audio effects 
processing producing audio effects psycho acoustically 10 
equivalent to audio effects produced by post processing 
a corresponding fullband, decompressed decoded audio 
signal, where said subband data comprises subbands of 
compressed, critically sampled audio subband data. 

2. The system of claim 1, wherein 15 
said synthesis filter bank in performing said audio effects 

processing uses less memory and computational 
resources than would be required for achieving psy- 
choacoustically equivalent audio effects on an decom- 
pressed decoded audio signal. 20 

3. The system of claim 1, wherein 

said synthesis filter bank performs said audio effects 
processing by applying different ones of said custom- 
ized subband effects filters and combinations thereof to 
different subsets of said subbands of said compressed 25 
audio subband data to achieve combinations of audio 
signal effects. 

4. The system of claim 1, wherein 

said set of prototype subband effects filters includes at 3Q 
least two audio effects filters from the set consisting 
essentially of an echo effects filter, a flange effects filter, 
a chorus effects filter, and a reverberation effects filter. 

5. The system of claim 1, further comprising: 

an analysis filter bank coupled to said data processor for 35 
compressing, encoding, and splitting a fullband audio 
signal into said compressed audio subband data. 

6. A method for performing audio effects processing on 
compressed audio subband data, said method comprising the 
steps of: ^ 

providing memory storage for compressed audio subband 
data, a set of prototype subband effects filters, custom- 
ized subband effects filters, and stored procedures that 
are executed by a data processor, said compressed 
audio subband data comprising subbands each covering 45 
a different frequency range, said set of prototype sub- 
band effects filters including effects filters correspond- 
ing to different audio effects that can be applied on a 
subband-by-subband basis, said stored procedures 
including at least one subband filter customization so 
procedure; 

executing said subband filter customization procedure to 
customize one or more prototype subband effects filters 
from said set of prototype subband effects filters to 
create said customized subband effects filters; 55 

performing decompression and decoding of said com- 
pressed audio subband data, and performing audio 
effects processing on said compressed audio subband 
data as part of said decompression and decoding, said 
audio effects processing performed by applying one or 
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more of said customized subband effects filters to a 
subset of said subbands of said compressed audio 
subband data, wherein said subset is less than the full 
set of said subbands, said audio effects processing 
producing audio effects psycho acoustically equivalent 
to audio effects produced by post processing a corre- 
sponding fullband, decompressed decoded audio 
signal, where said subband data comprises subbands of 
compressed, critically sampled audio subband data. 

7. The method of claim 6, wherein 

said audio effects processing uses less memory and com- 
putational resources than would be required for achiev- 
ing psychoacoustically equivalent audio effects on a 
decompressed decoded audio signal. 

8. The method of claim 6, wherein 

said audio effects processing is performed by applying 
different ones of said customized subband effects filters 
and combinations thereof to different subsets of said 
subbands of said compressed audio subband data to 
achieve combinations of audio signal effects. 

9. The method of claim 6, wherein 

said set of prototype subband effects filters includes at 
least two audio effects filters from the set consisting 
essentially of an echo effects filter, a flange effects filter, 
a chorus effects filter, and a reverberation effects filter, 

10. The method of claim 6, further comprising the steps 

of: 

compressing, encoding and splitting a fullband audio 
signal into said compressed audio subband data. 

11. An audio effects processing system for performing 
audio effects processing on compressed audio subband data, 
said system comprising: 

a set of subband effects filters, each for filtering audio 
subband data to generate an audio effect; said set of 
subband effects filters including a first set of effects 
filters for performing a first predefined audio effect; and 

a data processor for filtering a set of N parallel streams of 
audio subband data with said set of subband effects 
filters to produce an output signal, including applying 
said first set of subband effect filters to a subset of said 
N parallel streams of subband data, wherein said subset 
is less than the full set of said subbands; said filtering 
by said first set of subband effects filters producing 
audio effects psychoacoustically equivalent to audio 
effects produced by post processing a corresponding 
fullband audio signal, where said subband data com- 
prises subbands of compressed, critically sampled 
audio subband data. 

12. The system of claim 11, wherein 

said first set of subband effect filters includes M filters, 
where M<N; and 

said M subband effect filters include delay lines that 
utilize a total of approximately MxZ memory locations 
in said memory, where Z is an integer greater than zero 
and where an acoustically equivalent fullband effect 
filter would utilize approximately NxZ memory loca- 
tions. 

***** 
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